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=>afl s 4 processes image information picked up by an image 
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f r a veli ? g lane P° sition of its ow n vehicle based on right and 
Lft white line PO siti ons on a forward road obtained from the 

rC) cessed information. The device is provided with an 
P^tacle position detecting means 3 for detecting an obstacle 
otl the forward road, and when an obstacle is detected by the 
a ans 3 and the obstacle exists on either one of the right and 
* sides of the traveling lane already obtained by estimation, 
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a jnly based on the white line information on the side 
parated from the position of the obstacle out of the right 
a left white lines. 
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,j * NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] An image pick-up means to picturize the front road of a car, and an image-information- 
processing means to process the image information picturized with this image pick-up means, In the 
transit rain recognition equipment which offered a presumed means to presume the transit rain 
location to this car based on the white line location of the right and left front path on the street 
[ this ] obtained from the information processed with this image-information-processing means An 
obstruction location detection means to detect the location of this obstruction when an obstruction 
exists in this front path on the street is offered. This presumed means If this obstruction and a 
location this front path on the street are detected by this obstruction location detection means, when 
unevenly distributed in one of the right and left in this transit lane where this obstruction already 
presumed and was obtained Transit rain recognition equipment characterized by presuming this transit 
rain location by making into a subject white line information on the side isolated from this obstruction 
location among the white lines of the above-mentioned right and left. 
[Claim 2] This presumed means is transit rain recognition equipment according to claim 1 
characterized by to presume the transit rain location which made the subject white line information on 
the side isolated from the above obstruction location when this obstruction approaches within white 
line recognition distance from this car based on the detection information on this obstruction location 
detection means. 
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pE T AILED DESCRIPTION 



[petailed Description of the Invention] 
[0001] 

[pield of the Invention] In this invention, it is related to the transit rain recognition equipment which 
performs transit rain recognition in consideration of existence of obstructions, such as the precedence 
vehicle which exists in a front path on the street especially from the image information obtained by 
photography by a television camera etc. about the transit rain recognition equipment for grasping the 
transit rain convention configuration specified by the transit partition line represented with a white 
line by the road. 
[0002] 

[Description of the Prior Art] In recent years, a television camera is installed in an automobile, 
configuration grasp of the road under transit and the car posture over a road are grasped, and the 
technique which uses for automatic transit control of an automobile, or is used for various warnings to 
a driver is developed. For example, the technique about road white line recognition (transit rain 
recognition) in.which of it was made to steer by recognizing the point nearest to the white line 
location (white line recognition information) obtained by the last screen information out of this to be a 
wn ite line by making the high part of lightness into a white line candidate point among the image 
information from the camera installed in the car, and grasping a transit lane based on this road white 
lin e is indicated by JP,3-137798,A etc. 

[0003] Moreover, based on image information, it searches for lightness change in a longitudinal 
dire ction in white line retrieval area, and lightness change judges very few parts to be a part for the 
road department, and lightness change adjoins a part for very little road department, and the 
technique recognized to be a white line is indicated by JP, 7-85249, A about the part with a large 
lightness change. Although such road white line recognition equipment (transit rain recognition 
equipment) offers a camera (image pick-up means) and ECU (electronic control unit) which processes 
image information from a camera, acquires an image (real image) with a camera first and processes this 
image by ECU At this time, by ECU, after changing the image (subject-copy image) into the two- 
dimensional image of plane view and changing the road white line of a subject-copy image into the 
road white line of a plane view image, white line recognition is performed 
[0004] 

[Problem(s) to be Solved by the Invention] By the way, when recognizing a white line (transit partition 
line) path on the street, it will be the requisite that there is no obstruction in the space of a before 
[ from a camera / a white line ]. That is, if an obstruction is on the optical axis from a white line to a 
cam era, a white line cannot be caught with a camera, and naturally white line recognition cannot be 
performed. Ahead [ path / on the street ] where it actually runs, the fault which incorrect-recognizes 
a white line, such as the precedence vehicle running, or recognizing the edge parts of the fault from 
w hich the other car of these front serves as an obstruction, and white line recognition becomes 
difficult, and the front other car to be the edges of a white line, since a halt car exists, is. 
[0005] Therefore, he avoids the effect of a precedence vehicle on the street, and it enables it to want 
t0 be able to recognize a white line more correctly on the occasion of recognition of a white line 
(transit partition line). As the image field except this keepout area is processed by making into a 
processing keepout area the field where obstructions, such as a precedence vehicle, exist in JP.8- 
30770.A among the images about the transit partition line photoed with the television camera, the 
technique of avoiding the effect of a precedence vehicle front path on the street on the occasion of 
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recognition of a transit partition line is indicated. However, with this technique, logic, such as a setup 
of a processing keepout area, tends to become complicated, a high throughput is required of an image 
processing system, and cost quantity is caused. 

[0006] as it be originated in view of the above-mentioned technical problem , and this invention can 
avoid the effect of a precedence vehicle front path on the street on the occasion of recognition of the 
white line ( transit partition line ) by the image processing , without give a big burden to an image 
processing system , it aim at offer the transit rain recognition equipment which enabled it to recognize 
a transit lane more correctly by low cost . 
[0007] 

[Means for Solving the Problem] for this reason, with the transit rain recognition equipment of this 
invention according to claim 1 An image pick-up means to picturize the front road of a car, and an 
image-information-processing means to process the image information picturized with this image pick- 
up means, A presumed means to presume the transit rain location to this car based on the white line 
location of the right and left front path on the street [ this ] obtained from the information processed 
with this image-information-processing means is offered. The image information picturized with the 
image pick-up means is processed with an image-information-processing means, and a presumed 
means presumes the transit rain location to this car based on the white line location of the right and 
left front path on the street [ this ] obtained from this processed information. 
[0008] An obstruction location detection means to detect the location of this obstruction when an 
obstruction exists in this front path on the street is offered. Furthermore, with a presumed means 
When this obstruction and a location this front path on the street are detected by this obstruction 
location detection means If this obstruction is unevenly distributed in one of right and left on this 
transit lane that already presumed and was obtained, this transit rain location will be presumed by 
making into a subject white line information on the side isolated from this obstruction location among 
the white lines of the above-mentioned right and left. 

[0009] That is, if this obstruction location is unevenly distributed in the left white line side, a transit 
rain location will be presumed mainly based on the white line information on right-hand side, and if 
this obstruction location is unevenly distributed in the right white line side, a transit rain location will 
be presumed mainly based on the white line information on left-hand side. Thereby, presumption of 
this transit rain location comes to be performed, without being influenced of this obstruction. 
[0010] With the transit rain recognition equipment of this invention according to claim 2 Since this 
presumed means presumes the transit rain location which made the subject white line information on 
the side isolated from the above obstruction location when this obstruction approaches within white 
line recognition distance from this car based on the detection information on this obstruction location 
detection means When an obstruction is in white line recognition distance beyond (i.e., when there is 
no effect of an obstruction in recognition of a white line), this transit rain location will be presumed 
based on the white line information on on either side. 
[0011] 

[Embodiment of the Invention] Hereafter, with a drawing, when the gestalt of operation of this 
invention is explained, drawin g 1 - drawin g 5 show the automatic steering system using the transit rain 
recognition equipment as 1 operation gestalt of this invention, and this transit rain recognition 
equipment. The camera 2 as an image pick-up means to picturize the road condition ahead of [ this ] a 
car on a car 1 as shown in drawin g 2 , An obstruction location detection means 3 for obstructions, 
such as a precedence vehicle, to exist ahead [ car ] and to detect about the obstruction location of 
cod roe, An image-information-processing means 4 to process image information suitably from the 
image information from a camera 2, and to recognize the white line location of right and left front path 
on the street, A transit rain presumption means 5 to presume the location of a transit lane, and 
physical relationship with the description and a self-car from the white line location image information 
by this image-information-processing means 4, and the obstruction positional information from the 
obstruction location detection means 3 (presumed means), The steering actuator 21 for making a 
steering wheel 22 **** and the controller 6 which controls the steering actuator 21 based on the 
recognition result of the transit rain presumption means 5 are offered. In addition, 20 is a steering 
wheel. 

[0012] Moreover, the obstruction location detection means 3, the image-information-processing 
means 4, the transit rain presumption means 5, and a controller 6 are constituted as an electronic 
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control unit which comes to offer CPU, an input/output interface, ROM, RAM, etc. And this transit 
rain recognition equipment consists of the cameras 2, the image-information-processing means 4, 
obstruction location detection means, and the presumed means 5 as an image pick-up means. 
[0013] In addition, a car front transverse plane turns a camera 2 a little caudad, it is installed, and can 
be photoed by the predetermined photographic coverage of the road of the front a car runs. The 
obstruction location detection means 3 has offered radar information processing section 3B which 
processes the information from laser radar 3 A and this laser radar 3A. If an obstruction exists, 
especially laser radar 3A will detect the location of an obstruction, and the distance to an obstruction, 
while detecting whether some bodies (these are called obstruction), such as a precedence vehicle, 
exist in the front path on the street of a car 1 . 

[0014] That is, laser radar 3 A can make the image about the transit rain location caught with the 
camera 2 correspond, and can grasp the location on the radar of the body caught by laser radar 3A 
while it can detect the distance from the radar of the body which is turned ahead [ car-body ] and 
caught the detection direction by this laser radar 3A so that it might correspond with a camera 2. 
[0015] the transit rain location which the image about the transit rain location which caught the 
location on the radar of the body caught by laser radar 3A with the camera 2 in radar information 
processing section 3B was made to correspond, and the front body has already grasped — receiving - 
- right and left — it judges whether it is unevenly distributed in any. With the image-information- 
processing means 4, as shown in drawin g 2 , the subject-copy image 41 from a camera 2 is 
incorporated, a road white line extracts from this subject-copy image 41, and the image of the 
extracted road white line is changed into the plane view image 42 which was seen from the vertical 
upper part. About the extract of a road white line, it mentions later. 

[0016] With the presumed means 5, a transit rain location is presumed based on the positional 
information of the white lines 12L and 12R as a road-side line of the transit rain left end recognized in 
the plane view image 42 by the image-information-processing means 4, or a right end. The field 
specified with the road white lines 12L and 12R of the extracted right and left or the field specified 
from the rain width of face beforehand recognized to be extracted one side of the road white lines 12L 
and 12R on either side is presumed to be a transit lane. 

[0017] Especially, with this presumed means 5, a transit rain location is presumed according to the 
distance from a car to [ from obstruction information, such as a precedence vehicle detected with the 
obstruction location detection means 3, ] bodies, such as a precedence vehicle, and the longitudinal 
direction location (location to the transit lane based on the already detected transit rain information) 
of this body. By the controller 6, on the basis of the right-and-left center line (center line of road) 
location of the transit lane presumed with this presumed means 5, the right-and-left deflection 
(horizontal deflection) of a self-car, the direction of a self-car (angle of deviation beta), and the 
curvature (road curvature) of a transit lane are computed, and automatic steering control is performed 
based on these calculation results. 

[0018] As mentioned above, although presumption of a transit rain location is performed based on the 
positional information of the white lines 12L and 12R as a road-side line of the transit rain left end 
recognized by the image-information-processing means 4, or a right end, it explains recognition of 
white lines 12L and 12R here. In addition, although recognition of white line 12L as a road-side line at 
the left end of transit rain is explained, since the same is said of the case where it is based on white 
line 12R at the right end of transit rain, about left end white line 12L, a white line 12 will only be 
called here. 

[0019] With the image information recognition means 4, first, as shown in drawing 3 (a), in the flat 
ground, monochrome image information of the range ahead of a car (for example, 5m-30m) is 
incorporated with the camera 2 offered on the car 1, and a part of image of a lengthwise direction is 
omitted on a screen from this image information. And two or more horizontal lines 11 which are on this 
screen and become at equal intervals are set up. As incorporation of this monochrome image 
information is updated for every minute control period and shown in drawin g 3 (b), the necessary range 
of right and left of the white line location in the last screen (50 pixels [dot] of right and left [ Here ]) is 
set up as white line inquiry area (processing-object field) 10 on each horizontal line 11. Moreover, a 
first-time screen uses the white line location in a straight-line way as last screen data. 
[0020] And as shown in drawing 3 (c), the lightness of each horizontal line is differentiated in a 
longitudinal direction from the left, respectively. Moreover, the sign 14 in drawing is a guard rail. By 
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the way, the usual road surface has low brightness and its brightness change is also small. On the 
other hand, since brightness is very high as compared with the usual road surface, if a white line 12 
differentiates the lightness of a road in this way, differential data to which brightness change is 
subtracted by the boundary point to a road surface usual from plus and a white line 12 in brightness 
change by the boundary point from the usual road surface to a white line 12 will be obtained. Drawing 
3 (d) An example of such differential data is shown. 

[0021] And as the combination restored to extent (spacing to the peak of minus from the peak of plus 
is less than 30 dots) which the peak of a differential value appears together with the order of plus and 
minus about each data of each horizontal line 11 from the left, and is considered for spacing of each 
peak to be appropriate as a white line 12 is extracted as a white line candidate and shown in drawin g 3 
(e), the middle point is saved as a white line candidate point 15. 

[0022] And it leaves only the thing nearest to a photograph center among these white line candidate 
points 15 as a last candidate point. When a car 1 is left-hand traffic, the right-hand side in the 
retrieval area 10 is a path road surface with little [ usually ] brightness change, and the white line 
candidate point 15 nearest to this usual path road surface can judge this to be a white line 12. 
Therefore, even if it is the case where the body (for example, guard rail 14 grade) which causes a noise 
from a white line 12 on left-hand side further exists, a white line 12 can be certainly recognized from 
the image information picturized with the camera 2. 

[0023] And as shown in drawin g 3 (f), sequential verification of the continuity of the vertical direction 
of the white line candidate point 15 in each horizontal line data is carried out from the lower part of a 
screen at the last. First, the inclination between the vertical edges of the white line 12 in a front 
screen is calculated in advance. And if lowest point 15A is made into a white line 12, candidate point 
15B on the horizontal line 11 on one will verify whether it enters within the limits of inclination 
part**50dot of the last white line 12. 

[0024] If candidate point 15B is contained within the limits of this, this is made into a white line, when 
not entering, candidate point 15B will be dismissed and the coordinate which carried out interpolation 
count from the above-mentioned inclination will be regarded as a white line location. And the white 
line 12 which continued this detection by doing the activity same about each horizontal line can be 
recognized. And the activity of such white line recognition is done by continuing with a necessary 
period, and recognition of a white line 12 is updated each time. 

[0025] It is just carried out to recognition of white line 12R as a road-side line at the right end of 
transit rain like ** and this. The center line of road LCL which changes into the plane view image 42 
the white lines 12R and 12L on the subject-copy image 41 recognized each recognition period in this 
way with the image-information-processing means 4, and can be presumed from white line 12L at the 
left end of transit rain The center line of road LCR which can be presumed from white line 12R at the 
right end of transit rain It is based and the center line of road LC is presumed according to the 
detection information from the obstruction location detection means 3. 

[0026] That is, in the obstruction location detection means 3, by laser radar 3A, if the bodies 
(obstruction) 16, such as a precedence vehicle, are caught to a front path on the street, the distance 
from the car to this body 16 and the location of this body 16 on a radar will be detected, moreover, 
the transit rain location where the image about the already grasped transit rain location was made to 
correspond in, and this body 16 has already grasped the location on the radar of the body 16 caught 
by laser radar 3A from camera 2 information in radar information processing section 3B as shown in 
drawing 4 — receiving — right and left — it judges whether it is unevenly distributed in any. 
[0027] Here, by radar information processing section 3B, since it already grasps about the transit lane 
of the predetermined range ahead of a car (for example, 5m-30m), if the caught body 16 enters within 
the limits of this (from a car to namely, less than 30m), it will judge in which location a body 16 is to 
the transit rain location (road core) of this point (from a car to near 30m). If longitudinal-direction 
core 16A of the body 16 caught by radar 3A is being isolated from the car beyond predetermined 
distance (L0) to one of right and left to the already presumed transit rain core LCF in predetermined 
distance (30m), it will judge with it being unevenly distributed in the correspondence direction. 
[0028] In the example shown in drawin g 4 , longitudinal-direction core 16A of a body 16 is unevenly 
distributed in left-hand side from the transit rain core LCF, and only distance LI (Ll> it is referred to 
as L0) can be said that the body 16 is unevenly distributed in the left white line 12L side. With the 
presumed means 5, the center line of road LC is presumed according to the detection information from 
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such an obstruction location detection means 3. 

[0029] 1. although obstructions, such as a precedence vehicle, are ahead [ car ] when there are no 
obstructions, such as a precedence vehicle, ahead [ car ] and — this obstruction — a front path on 
the street — right and left — the case of being unevenly distributed in neither — each center lines of 
road LCL and LCR The center line of road LC (= LCL+LCR) is computed by averaging (for example, 
arithmetic average). 2. When obstructions, such as a precedence vehicle, are ahead [ car ] and this 
obstruction is unevenly distributed in one of right and left by the front path on the street, they are 
each center lines of road LCL and LCR. The center line of road LC is computed according to the 
information on the way that an obstruction is not unevenly distributed inside. 

[0030] That is, the center line of road LCL based on the white line of the left-hand side where this 
obstruction location exists if the center position of ** obstruction location is in a left from the center 
line of road LC computed till then (refer to drawin g 4 ) The center line of road LCR based on the 
white line of the right-hand side which remained since dependability became low It is adopted as the 
center line of road LC. On the contrary, the center line of road LCR based on the white line of the 
right-hand side where this obstruction location exists if the center position of ** obstruction location 
is in the method of the right [ center line of road / LC / which was computed till then ] The center 
line of road LCL based on the white line of the left-hand side which remained since dependability 
became low It is adopted as the center line of road LC. 

[0031] however, it is necessary to secure a continuity with the center line of road LC presumed till 
then when a condition changes between the condition (although there is an obstruction ahead of a car 
when there are no obstructions, such as a precedence vehicle, ahead [ car ] and — right and left — 
case it is unevenly distributed in neither) of 1., and the condition of 2. (when obstructions, such as a 
precedence vehicle, are ahead [ car ] and this obstruction is moreover unevenly distributed in one of 
right and left) For this reason, the low pass filter 43 which can carry out data smoothing to the output 
of the presumed center-line~of-road LC information is offered. 

[0032] In addition, if the center line of road LC is presumed in this way, based on this center line of 
road LC, horizontal deflection and the angle of deviation beta will be computed, and automatic 
steering will be performed. By the way, by the controller 6, based on the transit rain positional 
information over the car 1 presumed with this presumed means 5, the steering actuator 21 is 
controlled and automatic steering is performed. 

[0033] It is the automatic steering car which is made to **** a steering wheel 20 automatically and 
sells it at this car 1 based on the image picturized with the camera 2. That is, by the controller 6 The 
steering angle (this is called target steering angle) which should take a car from the physical 
relationship of the car 1 and transit lane which were presumed with the presumed means 5 is set up, 
actuation of the steering actuator 21 is controlled according to this set-up target steering angle, and a 
steering wheel 20 is ****(ed). 

[0034] Here, if control by the automatic steering system offered on the car 1 is explained, this 
automatic steering system will be learned from artificial steering actuation (steering actuation of a 
driver), and will perform automatic steering control. For example, that a driver performs steering 
actuation (modification of a rudder angle) is the case where this is corrected, when it stops suiting the 
direction of the road (transit lane) the transit direction of a car 1 is mainly running, and when the car 
1 tends to overflow the transit lane into right and left, also in order to modify this, it is performed. 
Although it is [ music roadway ] mainly under transit that the transit direction stops suiting the 
direction of a transit lane, even while running the direct roadway, the transit direction may separate 
from a transit lane because the posture of the car itself moves in the direction of a yaw. 
[0035] So, in this automatic steering system, it steers mainly so that the transit direction of a car 1 
may be doubled with the direction of a transit lane, and the steering element for correction of the 
longitudinal direction location of a car 1 is added to this. Moreover, in artificial steering (driver 
steering), from the information acquired visually, a driver judges the relative situation of a car and a 
road and is performing steering actuation. That is, based on the information which entered from the 
eye, a driver judges a location gap (horizontal deflection) of the relative relation (angle of deviation) 
between the transit direction of a car 1 and the direction of a transit lane and the longitudinal 
direction of a car 1, and it is performing steering actuation so that these may be corrected. 
[0036] If such a driver arranges the information acquired visually, it can classify into the radius of the 
curve of a road, the vehicle speed, and three elements of a degree of comfort (lateral acceleration, 
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width jerk). Moreover, it is the steering angle delta 0 to which the driver suited the curvature of 
steering actuation of a roadway since it was generally going to hold the steering angle uniformly when 
running a part, a direct roadway, etc. near the stationary circle of a music roadway, and this (at the 
time of stationary transit). It steers so that it may hold. 

[0037] On the other hand, to some extent this side of music roadway to steering angle delta steering- 
angle delta 0 according to the curvature of a music roadway in case it is going to advance from a 
direct roadway to a music roadway (at the time of transient transit) It is made to increase to ****. In 
this case, a driver starts steering from the how much this side of a point of going into a music 
roadway, or (that is, into how much is steering initiation distance D made?) sets [ what ] up whether 
the steering angle delta is made to increase comparatively (steering rate deltaV) in consideration of 
the vehicle speed, a degree of comfort (starting condition of lateral acceleration) expected at that 
time. 

[0038] That is, if the steering element which a driver determines on the occasion of steering actuation 
is classified, they are the steering angle delta 0, the steering initiation distance (steering initiation 
timing) D, and steering rate deltaV. It is divided. In a starting-this operation gestalt automatic 
steering system, automatic steering is performed by such the same technique as driver steering. For 
this reason, they are the amount delta 0 of each required for steering, i.e., a steering angle, the 
steering initiation distance D, and steering rate deltaV so that it may correspond to the presumed 
means 5 corresponding to the visual system of a driver, and the data-processing system of a driver. 
The controller 6 to set up is offered. 

[0039] And based on the center line of road LC in the plane view image 42 presumed with the 
presumed means 5, the angle of deviation beta in the point (namely, point of the predetermined height 
in plane view image 4B) which only predetermined distance separated from the car 1 is computed. As 
it is indicated in drawing 5 as this angle of deviation beta, it is the angle which the tangent and the 
direction of a car center line of the crooked center line of road LC make, and can compute further 
from the datum-line positional information in the point (all over drawing, it is indicated as an apogee) 
which left only a car 1 to the specified quantity detecting [ 2nd ] rather than the datum-line positional 
information in the point (all over drawing, it is indicated as a perigee) which only predetermined 
distance separated from the car detecting [ 1st ], and this perigee. 

[0040] That is, the angle of deviation beta is computed as an angle which the straight line which 
connected these points detecting [ 1st ] and points detecting [ 2nd ], and the center line of a car 1 
make. Thus, the angle of deviation computed is the angle of deviation in the way point (x mark in 
drawing) of the point (perigee) detecting [ 1st ] and the point (apogee) detecting [ 2nd ], and is the 
angle of deviation of a front point more than fixed from a car 1 at least. In addition, in this example, 
the point nearest to a car is made into the point detecting [ 1st ] among the center lines of road LC 
based on image information with a camera 2, horizontal deflection is computed based on this point 
detecting [ 1st ], and the curve radius R is further presumed based on the computed angle of deviation 
beta. 

[0041] Since the transit rain recognition equipment as 1 operation gestalt of this invention is 
constituted as mentioned above, white line recognition by this equipment is performed as follows. Or 
[ that the transit lane which is running the car is located from this white line recognition to a car with 
this equipment in what kind of location by performing white line recognition about white line 12L at 
the left end of transit rain, and white line 12R at the right end of transit rain ] (if it says conversely) 
Although it presumes in what kind of location a car is to a transit lane, left-hand side white line 12L is 
first explained to an example about recognition of each white lines 12L and 12R. 

[0042] First, as shown in drawing 3 (a), in the flat ground, monochrome image information of the range 
ahead of a car (for example, 5m-30m) is incorporated for every minute control period with a camera 2, 
and two or more horizontal lines 1 1 which are on this screen and become at equal intervals are set up 
for every period. And as shown in drawin g 3 (b), the necessary range of right and left of the white line 
location in the last screen (50 pixels [dot] of for example, right and left) is set up as white line inquiry 
area (processing-object field) 10 on each horizontal line 11. In addition, in an initial screen, the white 
line location in a straight-line way is used as last screen data. 

[0043] As shown in drawing 3 (c) from such image information, the lightness of each horizontal line is 
differentiated in a longitudinal direction from the left, respectively. The peak of the differential data 
[refer to drawin g 3 (d)] of such each horizontal line to a differential value appears together with the 



http : // www4 . ip dl . ncipi . go . jp/ cgi-bin/tran_web_cgLe jje 



2006/12/04 



x i-0i5952,A [DETAILED DESCRIPTION] , 7/8 ^ 

&er of plus and minus from the left. And the combination restored to extent (spacing to the peak of 
uS from the peak of plus is less than 30 dots) considered for spacing of each peak to be appropriate 
a white line 12 is extracted as a white line candidate, and the middle point is saved as a white line 
^•^riidate point 15 Lrefer to drawin g: 3 (e)l. 

fo° 44] And it leaves only the thing nearest to a photograph center among these white line candidate 
\nO& tS A u a la ? candldate P° int - Thus « even if it is the case where the bodies (for example, a guard 
l4 ' u T r tranSlt laneS * etc * ) which cause a noise from a white line 12 outside further by 

ftrH itin o g the , whlte Ime candidate point 15 to the thing nearest to a photograph center exist, a white 
t.^e 12 can be cert ainly recognized from image information with a camera 2. 
rO° 45 ^ Finally ' as snown in drawing_3 (f), sequential verification of the continuity of the vertical 
L r ection of the white line candidate point 15 in each horizontal line data is carried out from the lower 
Z^rt of f scr , een - f lrst ' the inclination between the vertical edges of the white line 12 in a front screen 
P ca lculated in advance. And if lowest point 15A is made into a white line 12, candidate point 15B on 
l n e horizontal line 11 on one compares whether it enters within the limits of inclination part**50dot of 
t fre I**? white line 12. If candidate point 15B is contained within the limits of this, this is made into a 
h ite "ne, and when not entering, candidate point 15B will be dismissed and will consider that the 
or dmate which carried out interpolation count from the above-mentioned inclination is a white line 
Ration. 

fo0 46] The continuous white line 12 can be recognized by doing such an activity about each horizontal 
Hoe- Tne activity of such white line recognition is done by continuing with a necessary period, and 
u pdates recognition of a white line 12 each time. In this way, although the white lines 12L and 12R of 
•ght and l eft of a transit lane are recognized periodically, it is carried out like this 
[o0 47] And the center line of road LCL presumed from white line 12L at the left end of transit rain 
rhe center line of road LCR presumed from white line 12R at the right end of transit rain It is based 
an d the center line of road LC is presumed according to the detection information from the 
obs truction location detection means 3. That is, in the obstruction location detection means 3, by 
laS er radar 3A, if bodies, such as a precedence vehicle, are caught to a front path on the street, the 
dista nce from a car to this body and the location of this body on a radar will be detected, moreover 
the transit rain location which the image about the transit rain location which caught the location on 
the ra dar of the body caught by laser radar 3A with the camera 2, and has already grasped it in radar 
^formation processing section 3B was made to correspond, and this body has already grasped — 
r ece ivmg nght and left — it judges whether it is unevenly distributed in any. 

r 0 048] Here, by radar information processing section 3B, since it already grasps about the transit lane 
of th e predetermined range ahead of a car (for example, 5m-30m), if the caught body enters within the 
liinits of this (namely, less than 30m) from a car, it will judge in which location a body is to a transit 
ra in location. And if the core of the body caught by radar 3A is being isolated beyond predetermined 
distance to one of right and left to the already presumed transit rain center line, it will judge with it 
be ing unevenly distributed in the correspondence direction. 

[0049] and — although obstructions, such as a precedence vehicle, are ahead [ car ] with the 
resumed means 4 according to the detection information from the obstruction location detection 
^eans 3 when there are no obstructions, such as a precedence vehicle, ahead [ car ] and — this 
obstr uction — a front path on the street — right and left — the case of being unevenly distributed in 
ne ither — each center lines of road LCL and LCR The center line of road LC (=LCL+LCR) is 
c omP uted °n the average. Moreover, when obstructions, such as a precedence vehicle, are ahead 
[ car J and this obstruction is unevenly distributed in one of right and left by the front path on the 
stree t, they are each center lines of road LCL and LCR. The center line of road LC is computed 
according to the information on the way that an obstruction is not unevenly distributed inside That is 
the center line of road LCR based on the white line of the right-hand side which remained when the 
center position of an obstruction location was in the left from the center line of road LC computed till 
then It is adopted as the center line of road LC. On the contrary, the center line of road LCL based 
on t he white line of the left-hand side which remained when the center position of an obstruction 
loca tion was in the method of the right [ center line of road / LC / which was computed till then ] It is 
a doP te d as the center line of road LC. 

[o0 50] In this way, based on the presumed center line of road LC, calculation of the horizontal 
deflection by the horizontal deflection calculation means 7, calculation of the angle of deviation 



beta 
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angle-of-deviation calculation means 8, and calculation of the curvature (road curvature) of the 
b ^ i> eXt 1 y th e curvature state estimation means 9 are performed, and automatic steering control 
t>e performed based on such calculation information. Thus, with this transit rain recognition 
jpment, without being based on the white line recognition information that dependability fell since 
e a obstruction exists, an obstruction location does not exist, but the center line of road LC comes to 
ff** ^resumed based on reliable white line recognition information, and there is an advantage which can 
&0*orm now presumption of the center line of road LC, i.e., presumption of a transit lane, with a more 
£,^*0 C ient precision. 

And radar laser 3A which becomes the subject of the obstruction location detection means 3 
iO recognize a transit lane more correctly, without be influence by the precedence vehicle front path 
c e> t ne street with low cost etc., without newly not install, and being able to equip this equipment by 
°W cost, and give a big burden to an image-processing system, since it is already install by the car 
\0 ; C ti performs distance-between-two-cars control etc. 

f£ 0 $2l Moreover since data smoothing of the center-line-of-road LC information presumed with the 
C^umed means 5 is carried out and it is outputted with a low pass filter 43, the control based on the 
^ c0 X\on of the center line of road LC can be stabilized in succession [ come ] smoothly, without the 
X °C^°v !! cen j ter o hne of road L C changing suddenly. In addition, with this operation gestalt, the 
X * I , ™ \ ?™ 6it , her Side are rec °g nized ' ^ >s based on each, and they are the center 

* n e$ of + r ° ad LC f- and LCR - Alth ough center line of road LC is presumed based on the detection 
£f<? rrn u 0n ?• obs L tructlon location detection means 3 after presuming Without recognizing about 
xi le near white line with which an obstruction location exists based on the detection information on the 
t'tmction location detection means 3 from the phase of recognizing the white lines 12L and 12R on 
it^ er , may constltute so that it may recognize only about the near white line with which an 
taction location does not exist, and you may constitute so that the center line of road LC may be 
churned based on the white line location in the direction of [ which has been recognized ] this In 
KiS case ' the burden to an image-processing system will be mitigated further 

I $ e ct of the Invention] As explained in full detail above, according to the transit rain recognition 
L ^ ipment invention according to claim 1, the image information picturized with the image 

Ji^ U ? f T anS u S processed with an image-information-processing means. Further with a presumed 
P an s If this obstruction is unevenly distributed in one of right and left on the already recognized 
n s it lane from the detection information on the obstruction front path on the street detected by the 
» truction location detection means Since this transit rain location is presumed by making into a 
%J' ect white line information on the side isolated from this obstruction location Without being based 
S tn e white line recognition information that dependability fell, since an obstruction exists An 
Vtruction location does not exist, but the center line of road LC comes to be presumed based on 
" lia ble white line recognition information, and there is an advantage which can perform now 
r gumption of the center line of road LC, i.e., presumption of a transit lane, with a more sufficient 
£ r0 cis lc >n. 



f o0 54] When an obstruction approaches within white line recognition distance from a car according to 
t V tranSlt ram rec °g nit ion equipment of this invention according to claim 2 When the transit rain 
a tion which made the subject white line information on the side isolated from the above obstruction 
cation is presumed and an obstruction is in the location which does not have effect in recognition of 
» white line of white line recognition distance beyond This transit rain location can be presumed 
e d on the white line information on on either side, and the presumed precision of a transit rain 
j^ ca tion can be raised. 



^ ran slation done.] 
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* NOTICES * 

-rpo an< * N ^^P^ are not responsible for any 
dama£ es caused b Y the use of this translation. 

X/ This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2 # #*** shows the word which can not be translated. 
3 [in the drawings, any words are not translated. 



DE SCRIPTION OF DRAWINGS 



[Brie f Description of the Drawings] 

[QEgjffingJl It is the block diagram showing the transit rain recognition equipment as 1 operation 
geS talt of this invention. 

[Drawing 2] It is the typical block diagram of the transit rain recognition equipment as 1 operation 
geS talt of this invention. 

[Drawmg_3] It is a mimetic diagram explaining the road white line recognition by the transit rain 
recognition equipment as 1 operation gestalt of this invention. 

[Qrawmg-il It is the mimetic diagram explaining detection of the obstruction location in the transit 
rain recognition equipment as 1 operation gestalt of this invention of the plane view image of a road 
[grawmg^J It is the mimetic diagram explaining the angle of deviation computed from the presumed 
result by the transit rain recognition equipment as 1 operation gestalt of this invention, and horizontal 
defl eCtlon of the plane view image of a road. 
[Description of Notations] 

1 Car 

2 Camera as an Image Pick-up Means 

3 obstruction Location Detection Means 
3^ Laser radar 

313 Radar information processing section 

4 jrnage-Information-Processing Means 

5 transit Rain Presumption Means (Presumed Means) 
l2 , 12L, 12R White line 

lQ Body (Obstruction) 
YjQ Center line of road 

[Translation done.] 
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